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ABSTRAC 


The  problem  considered  Is  a  two-dimensional,  constant  velocity,  point 
model  of  a  target  in  an  encounter  with  a  proportional  navigation  pursuer. 
The  horizontal  plane  is  chosen  so  that  the  effects  of  gravity  may  be  ne¬ 
glected.  Constraints  on  the  turning  rate  and  time  delays  in  both  the  pur¬ 
suer's  and  target's  guidance  system  arc  included. 

The  sensitivity  of  the  miss  distance  to  variations  in  the  parameters 
associated  with  pursuer  and  evader  is  presented. 
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SECTION  1 


INTRODUCTION 

With  the  introduction  of  modern  control  theory,  interest  has  been 
stimulated  in  optimal  pursuit-evasion  strategies.  From  studies  of  dif¬ 
ferential  games  it  has  been  indicated  that  for  certain  formulations  pro¬ 
portional  navigation  constitutes  the  optimal  pursuit  strategy  [ij. 

A  two-dimensional,  constant  velocity,  point  model  of  a  target  in  an 
encounter  with  a  proportional  navigation  pursuer  is  considered.  The  hori¬ 
zontal  plane  is  chosen  so  that  effects  of  gravity  may  be  neglected.  Mech¬ 
anization  of  proportional  navigation  introduces  numerous  effects  net  in¬ 
cluded  in  the  differential  game  formulation  [1].  Three  of  the  most  impor¬ 
tant  of  these  are  limits  on  the  turning  capability  of  the  pursuer,  a  time 
lag  in  the  control  system  of  the  pursuer,  and  a  time  lag  in  ;arget’s 
control  system.  Previous  studies  [2]  determined  the  optlmur'  *vaslve  tactics 
of  a  model  including  the  first  two  of  these  effects.  The  efirtt  .-  of  varia¬ 
tions  of  target  etnd  pursuer  parameters  on  the  optimum  mis.«  snd  the  optimum 
target  control  are  discussed. 


1 


SECTION  II 


DISCUSSION 


Mathe.Tiatlcal  Description  of  Problem 

Figure  1  gives  a  pictorial  description  of  the  encounter.  A  set  of 
state  variables  s,  y,  0.^.,  and  were  chosen  and  result  in  the  following 

ditferontial  equations. 


X  ---  cot,  0^  -  Vp  cos  0p 

y  =  sin  -  Vp  sin  Jp 

w  = 


a  I- I) 

(II-2 


(II-3) 


df  =  u,. 

The  turning  rate  of  the  pursuer,  Up,  is 
navigation  system  [3j.  In  ideal  proportional 
the  pursuer  is  proportional  to  the  time  rate 
0,  from  the  pursuer  to  the  target.  However, 
limiting  effects  on  the  pursuer  are  included, 
turning  radius  of  the  pursuer  and  (2)  a  time 
system . 


(II-4) 

determined  by  the  proportional 
navigation  the  turning  rate  of 
of  change  of  the  line  of  sight, 
for  this  problem  two  important 
These  are  (1)  a  limit  on  the 
lag  in  the  pursuer's  guidance 


Figure  2  shows  a  block  diagram  of  the  simplified  guidance  system  for 
two  constraints  mentioned  above.  A  nonlinear  function  limits  the  turn¬ 

ing  radius  of  the  pursuer.  It  was  assumed  that  hard  limiting  on  the  number 
of  G's  Che  pursuer  may  withstand  was  desired.  However,  the  application  of 
hard  limits  caused  discontinuities  in  the  derivatives  needed  for  the  opti¬ 
mization  method  used,  so  an  approximation  was  made.  The  arctangent  function. 
Figure  3,  was  chosen  to  approximate  the  hard  limits.  An  additional  differ¬ 
ential  equation  is  determined  from  Figure  2  and  3  which  governs  the  behavior 
of  the  pursuer's  turning  race.  Up. 


“  -^p  ^MAXP 


2  2 
X  +  y 


:3/7r)  tan'^  ^ 


(II  5; 


Tp  IS  the  time  con-stauC  introduced  into  the  pursuer's  guidance  system,  a  is 
the  pi upor t  ional  n;ivi  gation  constant,  and  is  the  desired  limit  on  the 
put  sue  I  G's. 


■file  same  types  of  limitations  Imposed  on  the  pursuer  ait  assumed  to  bi 
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lUock  Diagram  of  Pursuer  s  Guidance  System 
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^MAXP  t 


Figure  3.  Plot  ul  ’’'.(.i..') 


^'mAXP 


‘G 


-r 


U 


MAXP 


5 


Optimum  Control  Problem 

An  optimal  control  problem  can  now  be  formulated.  Given  the  plant 
equations  (11-11  through  (.11-6)  and  Che  index  of  performance  (II-7),  choose 
u  <  V,  V  =  [u;|u|sl)  so  that  -r®(t^)  is  a  minimum,  subject  to  the  differen¬ 
tial  side  constraint  (Equation  (ll-l)  through  (II-6)) 

Solution  of  Optimum  Control  Problem 

Using  Pontryagln's  Maximum  Principle  4  the  following  control  Hamiltonian 
results: 


H  =  p^  (V.J,  cos  -  Vp  cos  cjp)  +  p^  (V^  sin  0^  -  Vp  sin  0p) 

+  P.  K  +  +  Pi.  U  (3/7T)  tan'^  tT-^  ) 


■  0p  "P  “T  •'Up  L.Tp-'  MAXP 


MAXP 


■  T  “p  J  "haxt  “  -  73-  "t) 

'  p  ‘  — i  T*  ^ 

Note  that  the  target  control,  u,  enters  the  Hamiltonian  linearly.  Thus 
■'T 


u-*(t)  *  sgn  p,,  (t)  I 


r* 


(II-8) 


The  costate  equations  must  ‘jacl.sfy  the  differencial  equations; 
•  _  AC  r-y  (x^  +  +  2(yx  -.jx^x  ~| 

I’x  '  1  +  (Ad)-  L  +  y*)»  J 


dH 


y  dy  '^Up  1  +  (Ad)3  L 


AC _  ''x(x3  +  v»)  +  2i.yx  -  yx)y 

/  ^  V  ?5  /  -.3  ,  . 


Or  -t  y  ■ 


(II-IO) 


oH 


=  *P,.  V-  sin  dp  +  p,  V  cos  0 


.  do,  -  P  ‘  -y  P 


+ 


_  _ 

p  "l  +'(Ad)‘ 
P 


-x(Vp  COE  0p)  +  y('^p  si,,  r,  i 

"x®”  +  y*  ..i 


(11-11) 


p  -^4^—  ^  P  V  sin  0  -  p  V  t'-. 

^0^  d0j,  '  X  r  1  y  T 


r-x(V,j,  cos  0^)  +  y(V^  sin  0^) 
■Ppp  1  +  (Ad)-'  I.  x= 


(11-12) 


(11-13) 


^  .  .iiL  .  .p  +  B 

^Up  SUp  P^p  p 


m 


\  dUx  ’ 


(11-14) 


where 


JT_ 


c  =  JIMP  (3/ff) 


and 

x"  +  y* 

A  two-poinc  boundary  value  problem  results  with  the  following  boundary 
conditions : 


x(0),  y(0),  0p(O),  Up(0),  and  Ux(0) 

given  and  from  the  transversality  conditions 


(11-15) 


p^(t^)  =  2x(tp 

P,,(tp  =  2y(t^) 


(11-16) 


Pyp(tf)  *  0 


P,  up  -  0 

where  t^  is  the  terminal  time. 
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Choice  of  laltial  Conditions 

In  Equation  (11-15)  it  is  stated  that  the  Initial  conditions  on  the 
state  variables  are  given.  This  allows  slx-degrees-of-freedom  in  the  specifi 
cation  of  the  problem.  By  noting  chat  it  should  always  be  possible  to  choose 
the  axis  used  to  write  the  system  differential  equations,  see  Figure  1,  such 
that  the  x-axls  Is  parallel  to  the  initial  velocity  vector  of  the  target  with 
out  effectively  changing  the  results,  0^(0)  may  be  specified  as  zero  with¬ 
out  any  loss  of  generality. 


It  is  assumed  that  the  pursuer  is  aimed  such  chat  if  neither  the  target 
nor  the  pursuer  applied  any  control  interception  would  occur.  This  being 
the  case,  both  the  target  and  pursuer  would  follow  a  straight  line  course 
and  from  the  geometry  of  the  problem  two  of  the  initial  conditions  are  speci¬ 
fied  in  terms  of  other  problem  constants  as  follows: 

l«p(0)  =  0 

0p(O)  =  0(0)  sin  ^  0(0)} 


where  0(0)  is  the  initial  angle  of  the  line  of  sight  from  the  pursuer  to  the 
target  with  the  chosen  abscissa.  In  order  to  further  reduce  the  freedom  in 
the  specification  of  the  problem  it  is  assumed  that  0^(0)  =  0. 


With  the  above  considerations,  only  two  initial  conditions  remain  un¬ 
specified,  x(0)  and  y(0).  For  convenience  the  initial  range,  r(0),  and  the 
initial  angle  of  the  line  of  sight  from  the  missile  to  the  target  with  the  ab 
scissa,  0(0),  are  specified  and  x(0)  and  y(0)  are  calculated  from  these  value 


Numerical  Results 

A  steepest  ascent  procedure  [2,5]  for  which  the  differential  equations 
were  numerically  integrated  using  a  4th  order  Runge-Kutta  method  [6]  with 
time  step  sizes  of  0.1  seconds  was  formulated  which  would  determine  the 
optimal  control.  To  assure  good  accuracy  in  determining  the  miss  distance 
a  method  was  used  to  reduce  the  lime  step  size  near  ihe  terinlnal  time.  ilie 
problem  was  programmed  and  cun  on  an  IliM  350/65  syctetn.  A  nominal  case  wheic 


V.p  =  1013  ft/sec 


Vp  =  2252  ft/sec 

C  5 

MAXI  = 


‘^MAXP 
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=  1.0  sec 
I 

T p  -  0.5  .sec 


a  =  3.0 


wjs  chosen  and  for 
target  and  missile 
the  opti'  al  t.irg.aC 


paiticular  choices  or  r(0)  ia:d  0(0)  some  of  the 
parameters  were  varied  to  determine  their  effect  on 
r.iiiLCi  1  and  the  terminal  miss  distance. 
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Control  sequences  given  for  0®  <  *(0)  <  180°.  Control  sequences 

for  180°  <  0(0)  <  360  negative  of  the  ones  given. 

Area  A  -  target  maneuvers  pvirsuer  rsuch  that  pursuer  is 
directly  behind  target  then  executes  optimal  terminal 
maneuver.  Maximum  terminal  miss  approximately  equivalent 
for  all  points  within  this  area. 

•k 

Area  B  -  Optimal  control  u.j,  (t)  =  -1  for  all  t,  target 
able  to  turn  inside  of  pursuer  trajectory. 

-  Area  C  -  Optimal  control  bang-bang  with  one  switch, 
control  sequence  (+1,-1). 

Area  D  -  Op.imal  control  bang-bang  with  two  switches, 
control  sequence  (+1,-1, +1). 

Area  E  -  Probable  control  logic  is  to  maneuver  pursuer 
such  that  control  logic  of  Area  B  may  be  followed. 

Figure  5.  Target  Control  Sequence  Versus  Pursuer  Initial  Position. 
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Previous  work  [2]  has  shown  that  In  order  for  the  target's  maneuver  to 
obtain  the  greatest  miss  the  target  must  choose,  depending  on  the  initial 
conditions  r(0)  and  0(0),  the  best  from  several  control  philosophies.  The 
control  philosophies  thus  far  uncovered  result  in  one  of  the  following  types 
of  control: 

Control  A:  The  optimal  control  contains  two  or  more  switches 

and  only  the  terminal  portion  of  the  control  has  con¬ 
verged  to  the  constraint  ((U(t)|  *  1)  boundary. 

Control  B;  The  optimal  control  is  U(t)  =  +1  (or  U(t)  =  -1)  for 
all  t€(0,  t^). 

Control  C:  The  optimal  control  switches  once  from  U(t)  =  +1  to 

U(t)  =  -1  (or  switches  once  from  tl(t)  =  -1  to  13(1)  =  +1). 

Control  D:  The  optimal  control  contains  two  'twitches  from  one 
side  of  the  constraint  boundary  to  the  other. 

Figure  5  presents  these  controls  with  their  probable  philosophy  as  a 
function  of  the  pursuer's  initial  position  [23-  The  shape  of  the  control 
logic  areas  in  this  figure  are  only  a  "best  guess"  estimate  of  the  actual 
shape  from  data  presently  available.  The  distance  from  the  origin  is  r(0), 
whereas  the  angle  measured  in  a  counter-clockwise  direction  from  the  line 
marked  0”  is  0(0).  The  controls  thus  far  determined  resulting  from  initial 
conditions  in  area  E  are  of  the  form  of  Control  C  or  Control  D. 

For  Figures  6  through  10  one  of  the  target's  or  pursuer's  parameteis  is 
varied  (varied  parameter  noted  along  the  abscissa),  while  the  other  paroi  i  >  '..•/ 
are  maintained  at  the  values  denoted  in  Equation  11-17.  The  (a)  part  of  each 

figure  gives  the  miss  distance  obtained  when  the  target  uses  the  optimal  con¬ 
trol  as  a  function  of  the  varied  parameter.  The  (b)  part  of  eacli  figure  pre¬ 

sents  the  drffcretiee  ber.Jeen  the  terminal  time,  t.,  and  the  last  switching 
time,  t  ,  aiiJ  the  differ  tire  between  the  last  -wlr-hing  linie,  t  and  lit 
next  to  last  switching  time,  t^  ,  (if  these  difi  evenc..'.-,  vaIsl)  ~if  the  .pri 

iii.nl  control  as  a  function  of  the  target's  or  pui^-ui.'s  emiod  p.n  imetet .  Jtir 

difference  t,  -  t  and  t  -  t  ,  will  be  denoted  by  "ditfetence  in  switching 
f  n  n  n-l 

time"  in  future  reference.  Unless  otherwise  noted,  it  is  to  be  assumed  that 
for  each  of  the  figure.-'.  !he  initial  range  is  10,000  feer  .-.nd  tb''  fnitjal 
■ineli  r  tii^  lin'  m  .  ijlii  i  0  degree  ;. 

In  Figure  A  the  teri-iinal  mins  and  the  dif  f 'reiiec  In  switching  ttme.n 
is  plotted  -  '.s  tar,  f  and  pursuer  velocity.  The  solid  lilies  '.'ive  the 
variations  with  changes  in  pursuer  speed  vfhen  irr  t.-ifeei  -.pjed  is  .constant 
at  I, ill  i  ft/sec  and  Jhf  .ioi  ted  line  denotes  v.n  i -tt  it  •  s  iLiI  on  mges  in  the 
target's  speed  when  the  pursuer's  speed  is  held  totiSiani.  ar  2,252  ft/ser 
There  appears  to  be  a  greatest  miss  as  well  as  a  least  iiirc.s  fur  the  put - 
;;uer's  speed  within  the  range  shown.  For  pursuer  velocities  of  4,116  ft/::rc 
and  3,805  ft/sec  the  optimal  control  was  of  the  type  of  Control  C  and  for 
(die  points  run  where  the  pursuer's  velocity  was  between  3,494  ft/sec  and 
2,561  ft/sec  the  optimal  control  was  of  the  form  of  Control  D.  For  pursuer 
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2716  2407  2097  1788 
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PURSUER'S  SPEED  (in  ft/sec)  (b) 

Figure  6,  Effects  of  Varying  the  Target's  and  Pursuer 
Velocity.  (r(0)  =  10,000  ft.  and  0(0)  =  0.  O') 
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Figure  7.  Effects  of  Varying  the  Pursuer's  G  Limit 
1  r(01  ^  10,  000  It.  and  t;(0)  =  0.0°) 
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PROPORTIONAL  NAVIGATION  CONSTANT  (a) 


3,  5  — 


0.  5  1.5  2.  5  3.5  4.  5 

PROPORTIONAL  NAVIGATION  CONSTANT  (b) 

Figure  8.  Effects  of  Varj’ing  the  Proportional  Navigation 
Constant.  (r(0)  =  10,000  ft.  and  3(0)  r  0.  0“) 


speeds  between  2,407  ft/sec  and  1,478  It/soc  tlio  hesi.  Larjtoi  eonir^)l  lalcu- 
lated  was  like  Control  A,  It  is  inten-sC  iny  to  note  tlial  Idoa)  nii  n  i niinnp  were 

uncovered  where  the  target  control  was  U(t)  -1  for  ali  ;0,  t^j,  Control 

B,  for  pursuer  velocities  of  1,478  ft/sec  and  1,400  ft/.sec’and  that  the 
optimal  control  for  the  pursuer  speed  of  1,323  Et/sec  was  the  same  type. 
This  information  is  presented  by  the  crosshatched  line  in  Figure  6a  and 
•  Liowt  that  the  target  control  logic  changes  as  the  pursuer's  speed  is  varied 
between  1,478  ft/sec  and  1,322  ft/sec.  For  a  target  speed  of  394  ft/sec  the 
optimal  control  was  of  the  form  of  Control  D  and  for  the  other  points  tried 
the  optimal  control  was  of  the  type  of  Control  A. 

Figure  7  is  a  plot  of  the  miss  distance  and  the  difference  in  switch¬ 

ing  times  as  a  function  of  the  G  limit  imposed  on  the  pursuer.  As  might  be 
expected  the  miss  distance  decreases  as  the  "’lowable  number  of  G's  the 
pursuer  may  withstand  is  increased.  However.  appears  that  the  improve¬ 
ment  in  the  pursuer's  ability  to  capture  ;  '  .jet  is  small  if  the  G  limits 

are  increased  beyond  (for  Cnis  case)  15  G  .  le  difference  in  switching 
times  apparently  decreases  as  the  G  limit  imposed  on  the  pursuer  is  In¬ 
creased,  The  form  of  the  optimal  control  for  the  case  where  the  pursuer's 
C  limit  was  the  same  as  the  target's  (oc  5  G's)  was  of  the  type  of  Control 
f).  For  all  other  points  calculated  the  optimal  control  was  of  the  type  of 
Control  A. 

Figure  8  gives  the  effects  of  varying  the  proportional  navigation  con¬ 
stant.  For  the  problem  formulated  both  the  miss  distance  and  the  di.fference 
in  switching  times  decreases  as  the  proportional  navig.stion  constant  is  in¬ 
creased.  The  optimum  control  for  a  proportional  navigation  constant  of  1.5 

was  of  the  form  of  Control  8,  while  proportional  navigation  constant  of  2.0 

resulted  in  an  optimal  control  of  the  type  of  Control  C.  The  optimal  con¬ 
trol  I'or  all  other  calculated  points  was  of  the  form  of  Control  A. 

Figure  9  demonstrates  the  -  ffects  of  varying  the  pursuer  time  constant. 
The  solid  lines  in  the  a  and  b  parts  of  the  figure  represent  information  cal¬ 
culated  for  an  r(0)  of  10,00  •  feet  and  C(0)  of  0  degrees  while  the  dotted 
line  depict  .  information  obtained  for  an  r(0)  of  15,000  feet  and  0(0)  of  0 
degrees.  Both  the  miss  distance  and  difference  in  switching  times  increases 
.,s  the  delay  in  the  pursuers  guidance  system  is  increased.  The  form  of  the 
cpcimal  control  for  r(0)  =  10,000  .ret  was  of  Control  A  for  missile  time  de¬ 
cays  of  0.2  sec.  through  0.7  sec.  and  of  Control  D  for  the  remaining  points 
calculated.  The  r(0)  =  15,000  feet  case  was  presented  because  it  appears 
tnat  the  limit  imposed  by  the  terminal  time  for  the  case  of  r(0)  -  10,000 
fee.-  limited  the  freedom  of  the  switching  times  to  vary.  All  the  points 
calculated  for  r(0)  =  15,000  feet  resulted  in  an  optimal  control  of  tlie 
eorm  of  Control  A. 

The  last  figure.  Figure  10,  represent.s  infonaation  obtained  when  the 
target  or  pursuer  speed  is  varied  for  the  case  when  r(0)  =  20,000  feet  and 
c(0)  =  130  degrees.  For  this  case,  head-on  launch,  the  miss  distance  and 
carminal  difference  in  switching  time  both  decrease  as  the  pursuer's  speed 
IS  increased  (solid  line),  while  the  target's  speed  is  constant  at  1,013 
ft/sec.  If  the  pursuer's  speed  is  held  constant  at  2:252  ft/sec  and  the 
.arget's  speed  is  increased  from  394  ft/sec,  the  miss  distance  and  the  ter¬ 
minal  switching  time  ate  increased.  Again  there  is  n.cced  „  change  in  target 
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Figure  10.  Effects  of  Varying  Target's  and  Pursuer's  Velocity 
ri,f  Hoad  -  on  Case.  (r(0)  -  20,00''  ft.  and  ',(0)  -  180.0'-). 


control  logic  as  the  target k  or  pursuer's  speed  is  changed  through  the  range 
shown.  However,  it  should  be  noted  that  the  control  logic  resulting  in  con¬ 
trol  of  the  type  of  Control  B,  C  and  D  is  different  for  the  head-on  launch 
from  the  logic  resulting  in  these  controls  when  0(0)  =  0  .  For  target  speed 
of  394  ft/sec  the  optimal  control  is  or  the  form  of  Control  D;  for  target 
speed  of  703  ft/sec  and  1,013  ft/sec  the  form  of  the  control  is  of  Control  C; 
and  for  target  speeds  of  1,323  ft/scc,  1,633  ft/sec,  and  1,942  ft/sec  the 
1^11  f  i  the  control  is  control  B.  For  pursuer  speeds  of  1,323  ft/sec  through 
2,561  ft/sec  the  control  is  similar  to  control  C,  while  a  pursuer  speed  of 
2,872  ft/sec  resulted  in  a  control  like  Control  B. 

The  results  of  the  parameter  sensitivity  studies  indicate  that,  as  ex¬ 
pected,  the  miss  distance  is  strongly  dependent  on  the  parameters  of  the 
proportional  navigation  system.  The  results  follow  the  trend  described  in 
;  7],  where  a  proportional  navigation  missile  is  studied  against  a  target 
employing  fixed  (non-optimal)  tactics. 

An  interesting  effect  is  the  differences  observed  for  a  launch  froni 

.  =  0°and  0  =  180°.  The  variations  with  velocity  show  a  reversal  for  the 

cases  0=0°,  and  0  =  180°.  Thus,  it  is  indicated  that  a  low  speed  pursuer 
ii.  preferable  for  rear  hemisphere  launches,  while  a  high  speed  pursuer  func¬ 
tions  best  for  head-on  launches.  It  is  to  be  noted,  however,  that  the  pre- 
;  rence  of  ?.  high  speed  missile  for  head-on  launches  is  based  on  the  assump¬ 
tion  of  errorless  launches.  The  high  speed  missile  would  be  iiuch  more 
sensitive  to  launch  errors.  The  launch  error  problem  is  under  investigation 
and  will  be  rep  rted  on  in  the  near  future. 
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SECTION  III 


CONCLUSIONS 

The  results  of  this  study  indicate  that  best  control  logic  for  the 
target  control  and  the  choice  of  switching  times  for  the  optimal  target 
control  depend  on  the  particular  value  of  target  and  missile  parameters, 
as  well  as  the  particular  initial  condition  r(0)  and  0(0).  The  relatively 
smooth  variations  in  the  difference  in  switching  times  may  make  it  possible 
to  determine  an  empirical  relationship  between  the  switching  times  and  ter¬ 
minal  time,  at  least  for  some  of  Che  control  philosophies,  involving  the 
target's  and  pursuer's  par2uneters.  In  order  to  determine  such  a  relationship 
it  would  probably  be  necessary  to  limit  results  to  one  control  logic  disci¬ 
pline.  Additional  work  would  then  be  necessary  to  determine  the  best  con¬ 
trol  logic  to  follow. 
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